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Abstract. In this paper we study tangcntially degeneracy of the orbits of 
s-representations in the sphere. We show that an orbit of an s-representation 
is tangentially degenerate if and only if it is through a long root, or a short 
root of restricted root system of type G2 . Moreover these orbits provide many 
new examples of tangentially degenerate submanifolds which satisfy the Ferus 
equality. 



1. Introduction 

A submanifold is called tangentially degenerate if its Gauss mapping is degener- 
ate. The investigation of tangentially degeneracy of submanifolds has long history. 
For example the classification of surfaces in R 3 with degenerate Gauss mapping 
is equivalent to the classification of flat surfaces in R 3 . As a result, that is one 
of planes, cylinders, cones or tangent developable surfaces. In this paper we shall 
investigate the Gauss mapping of a submanifold in the sphere, that is defined as a 
mapping to a Grassmannian manifold. The definition of the Gauss mapping, which 
here we deal with, will be given in Section 2. Ferus [I] obtained a remarkable result 
for tangentially degeneracy of submanifolds in the sphere. He showed that there 
exists a number, so-called the Ferus number, such that if the rank of the Gauss map- 
ping is less than the Ferus number, then a submanifold must be a totally geodesic 
sphere. However, in general it is still unknown whether there exist submanifolds 
which satisfy the Ferus equality, that is, the equality of the Ferus inequality. In 
their papers [9l [lOl [IT] , Ishikawa, Kimura and Miyaoka studied submanifolds with 
degenerate Gauss mappings in the sphere via a method of isoparametric hyper- 
surfaces. They showed that Cartan hypersurfaces and some focal submanifolds of 
homogeneous isoparametric hypersurfaces are tangentially degenerate. Moreover, 
some of them satisfy the Ferus equality. 

A homogeneous isoparametric hypersurface in the sphere is obtained as an orbit 
of an s-representation of a compact symmetric pair of rank 2. Therefore we shall 
study submanifolds with degenerate Gauss mappings via a method of symmetric 
spaces. Our strategy is to investigate the space of relative nullity of the orbits. In 
fact, the index of relative nullity is equal to the rank of tangentially degeneracy. 
We will study the second fundamental form of the orbits of s-representations by 
restricted root systems, and determine their spaces of relative nullity. As a result, 
we will obtain that the space of relative nullity of the orbits through a long root, 
or a short root of restricted root system of type G2, is coincide with the root space 
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of that root. Hence these orbits are tangentially degenerate. We note that these 
orbits are weakly reflective submanifolds as we showed in the previous paper [8]. 
Moreover, we will show that the orbits of s-representations with degenerate Gauss 
mapping are exhausted with above orbits. Finally we shall observe that these orbits 
provide many new examples of tangentially degenerate submanifolds in the sphere 
which satisfy the Ferus equality. 

2. Submanifolds with degenerate Gauss mappings 

Let / : M — ► S n be an immersion of an Z-dimensional manifold M into an 
n-dimensional sphere S n . The Gauss mapping 7 of / is defined as a mapping from 
M to a Grassmannian manifold G;+i(R n+1 ) of all (I + l)-dimensional subspaces in 
R n+1 by: 

1 :M — > G ;+1 (R n+1 ) 

x .— > R/(x)©T /(l) (/(M)). 

We denote by r the maximal rank of the Gauss mapping 7 of an immersion /. If the 
Gauss mapping is degenerate, i.e. r < I, then an immersed submanifold f(M) C S n 
is said to be tangentially degenerate or developable. We note that 7 is constant, i.e. 
r = 0, if and only if f(M) is a part of a totally geodesic sphere. 

We denote by h and A the second fundamental form and the shape operator of 
/, respectively. Chern and Kuiper [3] introduced the notion of the index of relative 
nullity at x G M, that is the dimension of the vector space 

M x = {X G T X {M) I h(X, Y) = 0, v y G T X (M)} 
= f| ker ( A «)- 

It is easy to show ker(c?7) 2; = Af x , therefore the index of relative nullity is equal to 
the degeneracy of the Gauss mapping at each point . 

Let / : M — ► S n be an immersion of a compact, connected manifold M of 
dimension I. Ferus [4] showed that there exists a number F(l), which only depends 
on the dimension I of M, such that the inequality r < F(l) implies r = 0. Then 
f(M) must be an ^-dimensional great sphere in S n . Here the number F(l) is called 
the Ferus number and given by 

F(l) = min{fc I A(k) + k>l}, 

where A(k) is the Adams number, that is the maximal number of linearly inde- 
pendent vector fields at each point on the (k — l)-dimensional sphere S k ~ 1 . Any 
positive integer k can be written as (2s + 1)2* by some non-negative integers s and 
t. We write t = c + 4d by some < c < 3 and < d. In this situation the Adams 
number A(k) can be calculated by 

A(k) = 2 c + 8d- 1. 

Regarding the Ferus inequality, Ishikawa, Kimura and Miyaoka posed the fol- 
lowing problem: 

Problem 2.1 (10 ). (1) Is the inequality r < F(l) best possible for the impli- 
cation r = ? Do there exist tangentially degenerate immersions M l — > S n 
with r = F(l) ? 
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(2) If the above problem is true, classify tangentially degenerate immersions 
M l -► S n with r = F(l). 

For these problems, they obtained the following results using isoparametric hy- 
persurfaces in the sphere. It is well-known that the number g of distinct principal 
curvatures of an isoparametric hypersurface in the sphere is 1, 2, 3, 4 or 6. A 
minimal isoparametric hypersurface with g = 3 is called a Cartan hypersurface. 

Theorem 2.2 (|9J). A homogeneous compact hypersurface in the real projective 
space R.P™ which is tangentially degenerate is projectively equivalent to a hyperplane 
or a Cartan hypersurface. 

Theorem 2.3 When M is a homogeneous isoparametric hypersurface in the 

sphere with g — 6, then both focal submanifolds of M are tangentially degenerate. 
Moreover, these submanifolds satisfy the Ferus equality. 

Theorem 2.4 ([10 ). When M is a homogeneous isoparametric hypersurface in the 
sphere with g = 4, then one of focal submanifolds of M is tangentially degenerate, 
and another one is not. Moreover, some of them satisfy the Ferus equality. 

3. Orbits of s-representations 

A linear isotropy representation of a Riemannian symmetric pair is called an 
s-representation. In the following section, we will study orbits of s-representations 
which are tangentially degenerate. For this purpose, we shall provide some funda- 
mental notions of orbits of s-representations in this section. 

Let G be a compact, connected Lie group and K a closed subgroup of G. Assume 
that 9 is an involutive automorphism of G and Gg C K C Gg, where 

G e = {g G G \ 9(g) = g} 

and Gg is the identity component of Gg. Then (G, K) is a compact symmetric pair 
with respect to 9. We denote the Lie algebras of G and K by g and 6, respectively. 
The involutive automorphism of g induced from 9 will be also denoted by 9. Then 
we have 

t = {x e 9 \9(x)=x}. 

Take an inner product ( , ) on g which is invariant under 9 and the adjoint repre- 
sentation of G. Set 

m = {X eg\9(X) = -X}, 
then we have a canonical orthogonal direct sum decomposition 

g = i + m. 

Fix a maximal abelian subspace a in m and a maximal abelian subalgebra t in g 
containing a. For a G t we set 

(3.1) g tt - {X G g c | [H, X] = V^T(a, H)X (H G I)} 
and define the root system R of g by 

(3.2) i?={aet-{0}|g Q ^{0}}. 
For A G a we set 

gA = {X G g c | [H, X] = V=1(\,H)X (H G a)} 
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and define the restricted root system R of (g, 6) by 

i? = {Aea-{0}| flA ^{0}}. 

Set 

R a = RC\t 

and denote the orthogonal projection from t to a by H H . Then we have 

fl={a|a£fl- R }. 

We take a basis of t extended from a basis of a and define the lexicographic ordcrings 
> on o and t with respect to these bases. Then for H e t, H > implies H > 0. 
We denote by F the set of simple roots of R with respect to the ordering >. Set 

F = PnR , 

then the set of simple roots F of R with respect to the ordering > is given by 

F = {a | a G F — F }. 

We set 

R+ = {a G R | a > 0}, R+ = {X e R \ X > 0}. 

Then we have 

R + = {a | a e R+ - R }. 

We also set 

t = {X e I | [X,H] = (H G a)}, 

and define 

8a = 6n (fl A + 0-a), m A = mn (g A + 0-a) 
for A e Under these notations, we have the following lemma. 

Lemma 3.1. (1) We have orthogonal direct sum decompositions 

t = t +^2t x , m = a+ ^ m A . 

Aei? + \er+ 

(2) If H e a and (A, H) ^ 0, £/ien ad(if) gives a linear isomorphism between 
m.\ and t\. 

Wc define a subset D of a by 

D= \J{H e a I (X,H) =0}. 
Ae« 

A connected component of a — I? is a Weyl chamber. We set 

C = {H e a | (A, H ) > (A e F)}. 
Then C is an open convex subset of o and the closure of C is given by 

C = {H e o | (A, H) >Q{X^F)}. 
For a subset A c F, we define 

C A = {H e C | (A, ff) > (A g A), (/i, H) = (/i G F - A)}. 
Lemma 3.2. (1) For Ai C F, t/ie decomposition 

C^ = \J C A 

AcAi 

is a disjoint union. In particular, C — [J C A is a disjoint union. 

ACF 
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(2) For Ai,A 2 C F, Ai C A 2 if and only if C Al C C A *. 
For each A € F, we take ff>, € a such that 

<*&,/.>={; fex> (Aien 

Then, for A C F, we have 




We set 

R A = Rn{F-A) z , R A = R A nR+. 
Under these notations, we have the following lemma. 

Lemma 3.3 ( 6 ]). Fix a subset A C F. For H £ C A we have the following: 

(1) R A = {XeR\ (X,H)=Q}, 

(2) R A = {XeR+ | (X,H)=0}. 

Now we shall study an orbit Ad(K )H of the linear isotropy representation of 
(G, K) through H e m. We set 

Z% = {keK\ Ad(k)H = H}. 

Then is a closed subgroup of K and the orbit Ad(K)H is diffeomorphic to the 
coset manifold K/Z^- The Lie algebra 3^ of Z^- is given by 

£ = {Xet\[H,x]=o}. 

An orbit Ad(K)H is a submanifold of the hypersphere S of radius ||if || in m. From 
[6j, Ad(K)H is connected. Since 

m = (J Ad(fe)C, 

without loss of generality we may assume H £ C. Moreover, from Lemma 13.21 
there exists A C F such that H S C A . From Lemma 13.11 we have the following 
lemma. 

Lemma 3.4 ([8 ). For A C F and H € C A , the tangent space T H (Ad(K)H) of 
the orbit Ad(K)H at H and the normal space T^(Ad(K)H) in the hypersphere can 
be expressed as 

(3.3) T H {Ad(K)H) = m M> 

(3.4) T^(Ad{K)H) = ar\H ± + m„ = Ad((Z#) )(a n iT^), 
where (Z^)q is the identity component of the stabilizer Z^ of H in K. 
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4. Orbits of s-representations with degenerate Gauss mappings 

4.1. Tangentially degenerate orbits. Let (G,K) be a compact symmetric pair. 
We assume that (G, K) is irreducible, namely K acts irreducibly on m. We consider 
the orbit Ad(K)H through H e o. In this section, we study the orbits with degen- 
erate Gauss mappings. Since the tangentially degeneracy of the orbit is invariant 
under scalar multiples on the vector space m, we do not discriminate the difference 
of the length of a vector H. When (G,K) is of rank 1, K acts on the sphere in 
m transitively. Therefore we only consider a symmetric pair whose rank is greater 
than or equal to 2. The following theorem is the main result of this paper. 

Theorem 4.1. An orbit of an s -representation is tangentially degenerate if and 
only if it is through a long root (any root when all roots have the same length), or 
a short root of restricted root system of type Gi . Let A e R be such a root. Then 
the tangentially degeneracy of the orbit Ad(K)X is kei(d'y)x = m\. 

To prove this theorem, we show the following proposition first. 

Proposition 4.2. If the orbit Ad(K)H through H e a is tangentially degenerate, 
then H is a constant multiple of a restricted root. 

Proof. First we note that 




Seariff- 1 - 



p| ker(Ad(fc)^Ad(fc) _1 ) 



fee(zg)o 



p| ker^AdO)- 1 ) 



fee(zg)o 



f] Ad(fc)kcr^ 



{Gooff -L 



P Ad(ife) P kerA c . 
For £ € o n H 1 - the set of eigenvalues of A^ is given by 




and the eigenspace associated with eigenvalue — (A, £)/(A, H) is given by 
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See [8] for details. The space kerA^ is nothing but the eigenspace associated with 
O-eigenvalue. Thus 

kerA c = 



m. 



P| kerA e = p Ad(fc)£m M c£ 



m,. 



Therefore we have 

hence 
(4.1) 

Consequently, if Ad(i4T)7J is tangentially degenerate, then H must be a constant 
multiple of a restricted root. □ 

From the above proposition, hereafter, we may consider the orbit through a 
restricted root, i.e., we may put H = A G R+. We set 

A = {neF\ Ox, A) >0}. 

Then we have A G C A . If 2A g R+, then t + t A is a Lie subalgebra of t. We denote 
by if (A) the analytic subgroup of K which corresponds to to + i\. 

Proposition 4.3. If A G R+ satisfies 

(a) 2 A i R+, 

(b) X + v^R and X — v ^ R for all v G i?+ , 
i/ien Ad (if) A is tangentially degenerate. 

Proof. Since the tangent space of the orbit Ad(i"QA at A is given as in (|3.3p . the 
image of A by the Gauss mapping 7 is 



7 (A) =RA+ J2 



m. 



and its orthogonal complement in m is 

7(A)^ = anA^+ £ 

From a rule of the bracket product of root spaces and the assumption (b) , we have 



ueR* 



fo,anA i + Y m " 
Therefore 

to + 6a, an A" 1 + Y m " 



t A ,an A x + Y m » 



{0}. 



ueRi 



C an A J 



J2 m - 



This yields 



Ad(K{\)) a n A 1 - + ^ = aflA 1 + ^ m u . 



ueR* 
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Hence 

Ad(K(X)) ■ 7 (A) = 7 (A). 

Since 7 is i^-equivariant, we have 

7(Ad(Jb)A) = Ad(fc) 7 (A) = 7(A) 

for any k E K(X). This means that 7 is constant on Ad(K(X))X. It is clear that 
Ad(K(X))X is not a point, since T A (Ad(A'(A))A) = rriA- Consequently Ad(K)X is 
tangentially degenerate. □ 

We denote by 5 E R + the highest root of R. 
Lemma 4.4 ( 13J). For X E R+, 

(A, 5) 



(when X _L 5), 
= ^ 1 (when X = 5), 
1/2 (otherwise). 



When (X,6}/\\6\\ 2 = 0, thenX-5 is not a root. When (X,5)/\\5\\ 2 = 1/2, then X-S 
is a root. 

Proof. Since 8 is the highest root, clearly A + 5 is not a root. We express <5-series 
containing A as A + n5 (p < n < 0). Then 

Now we shall show p — 0, — 1 or —2. If we assume that p < —3, then \i = X — 35 is 
a root. Then, from the square norm of 36 = X — /1, we have 

9||'5|| 2 = l|A|| 2 + ||Ml| 2 -2(A, Ai ). 

From ||A|| < ||i5||, \\n\\ < \\5\\ and Cauchy's inequality 

-(Aw^^iiaiiiimII^ii^ii 2 , 

we have 9||<5|| 2 < 4||(5|| 2 . This is a contradiction. 

In the case of p = 0, A is perpendicular to 5 and A — 6 is not a root. In the case 
of p = —1, (A, <5)/||i5|| 2 = 1/2 and A — 5 is a root. When p — —2, then X = S from 
Cauchy's inequality. □ 



From Proposition 14.31 and Lemma 14.41 we have the following corollary. 

Corollary 4.5. The orbit Ad(K)S through the highest root 5 of R is tangentially 
degenerate. 

Since a long root is conjugate to the highest root under the action of the Weyl 
group, it satisfies the conditions of Proposition ^. 31 Especially in the case where the 
lengths of all roots are equal, all roots satisfy the conditions of Proposition ^. 31 We 
determine short roots satisfying the conditions of Proposition 14.31 in the following 
proposition. 

Proposition 4.6. Short roots satisfying the conditions (a) and (b) of Proposition 
4-. 3 are only short roots of the restricted root system of type G^. 
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Proof. We will follow the notations of root systems in [2] . 
In the case of type B, the restricted root system is given by 

R = {±e % | 1 < i < p} U {±a ± ej | 1 < % < j < p}. 

If we add ie^ to a short root ±ej (i ^ j), then it becomes a root again. Thus any 
short root does not satisfy the condition (b). 

In the case of type C, the restricted root system is given by 

R = {±2e, t \ l<i<p}U {±e l ± e 3 - | 1 < i < j < p}. 

Short roots are ±ej ± ej. By the action of the Weyl group, it suffices to consider a 
short root e\ + e<i. The set of roots which are perpendicular to e\ + e 2 is 

{±(ei - e 2 )} U {±2e, | 3 < i < p} U {±e, ± ej | 3 < i < j < p}. 

Since 

(ei + e 2 ) + (ei - e 2 ) = 2ei G i?, (ei + e 2 ) - (ei - e 2 ) = 2e 2 G R, 

e\ + e 2 does not satisfy the condition (b). 

In the case of type G 2 , we can easily see that all short roots satisfy the conditions 
(a) and (b). 

In the case of type BC, the restricted root system is given by 

R = {±2e,, ±e l \l<i<p}U {±e, ± ej | 1 < i < j < p}. 

We can see that short roots ±ei, ±e^ ± ej do not satisfy the condition (b) by a 
similar way in the case of types B and C. 

The root system of F4 contains a root system of type _B 2 as a sub-system. Then 
a short root of type F4 can be regarded as a short root of type £? 2 . Thus in this 
case a short root does not satisfy the condition (b). □ 

By the above discussion we obtained that the orbits stated in Theorem 14.11 arc 
tangentially degenerate. In order to determine the spaces of relative nullity of 
these orbits and to show other orbits are not tangentially degenerate, we give the 
following criterion for an orbit of an s-representation to be tangentially degenerate. 

Proposition 4.7. The orbit Ad(i^)A through a restricted root X G R is tangentially 
degenerate if and only if there exists a non-zero subspace of X^//a m M which is 
invariant under adfj^-). More precisely, 

(4.2) ker(d 7 ) A = f| Ad(fe) £ m M 

and ker(G?7)> is the maximal subspace ofY^^f/x m M which is invariant under ad(3^-). 

Proof. From (|4.1|) we have (|4.2j) immediately. Thus the orbit Ad(K)X is tangentially 
degenerate if and only if the right-hand side of (14. 2p is a non-zero vector space. 

If there exists a non-zero subspace V of Xw/a m /j w hi cn is invariant under 
Ad((Z£) ), then 

p| Ad(fc)^m M D p| Ad(k)V = V ± {0}. 

fce(z£) m/A k£(z*) 
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Hence Ad(K)X is tangentially degenerate. Conversely, we assume that Ad(K)X is 
tangentially degenerate. Then 

n Ad ^) e c e m ^ 

ke(Z^)„ ft//A ft// A 

is a non-zero subspace, and we denote it by V. Then for any g e (-Z^-)o we have 
Ad(g)V = Ad(g) f| Ad(fc) ]T m M 

ke(Z^) Q ft//A 

= fl Adfofc) I>„ = V. 

fce(z£) f»//A 

Thus V is invariant under Ad((Z^-) ). Consequently, the orbit Ad(K)X is tan- 
gentially degenerate if and only if there exists a non-zero subspace of Xw/a m p 
invariant under Ad((Z^)o). Since 3^ is the Lie algebra of a connected Lie group 
(-Z^-)o, we obtain the assertion. □ 

In particular, for an orbit of the adjoint representation of a compact Lie group 
we have the following corollary. 

Corollary 4.8. An adjoint orbit of a compact, connected semisimple Lie group 
through a root a is tangentially degenerate if and only if there exists a non-zero 
subspace of 

sn (g Q © Q- a ) 

which is invariant under ad(jg). 

Lemma 4.9. Let X be a root and V a non-zero subspace ofm\. Then V is invariant 
under ad(3^) if and only ifV is invariant under ad(Bo) and satisfies 



E *•» v 



= {0}. 



Ln addition, if the action of to on m\ is irreducible then V = m\ . 
Proof. Since 

} X K = {Xet I [X,X] = 0} = t © E 



V is invariant under ad(3^-) if and only if V is invariant under ad(t ) and 



E e - v 



c V c m A . 



On the other hand, 



Hence we have 





C 


E ^> m ^ 









C Y ( m A+^ ©™A-i/)- 



v£R$ 





< 







C m A n ^ {m x+v © m A -„) = {0}. 



»eR$ 
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Lemma 4.10. The root space ms corresponds to the highest root 5 is a subspace of 
X^/a^V invariant under a,d($ 5 K ). 

Proof. The Lie algebra i s K of Z & K is given by 

& = {xet\ [x,s\ = o} = t ® e - 

From Lemma l4.4| we have S ± v ^ R for any v £ R + which is perpendicular to i5. 
Hence from Lemma |4.9[ m$ is invariant under ad^f^). □ 

From this lemma, we have the following proposition immediately. 

Proposition 4.11. Let (G,K) be a compact symmetric pair. Then the orbit 
Ad(K)S through the highest root S is tangentially degenerate. Moreover, kerf^^ = 
m$ except the case of type BC . 

Similarly we also have the following proposition immediately. 

Proposition 4.12. Let (G,K) be a compact symmetric pair with restricted root 
system of type Gi- Then the orbit through any root A is tangentially degenerate. 
Moreover, kei(d r y)\ = m\. 

Proposition 4.13. Let G be a compact connected simple Lie group. An adjoint 
orbit of G is tangentially degenerate if and only if it is through a long root, or a 
short root in the case of compact simple Lie group Gi . 

Proof. We have already shown that the orbit through a long root, or a short root 
of the simple Lie group G2 is tangentially degenerate. Therefore it suffices to show 
that, in the case of G ^ G2, the orbit Ad(G)a through a short root a 6 R + is not 
tangentially degenerate. 

Assume that V is a subspace of g(l (g a ®0- a ) invariant under adfjg). Then the 
complexification V c C g a ® 0-q of V is a complex vector space which is invariant 
under ad(3§). We take v <G V c and express as v = X a + X- a (X± a 6 g± a ). In 
this case, from Proposition 14. 61 there exists j3 E R+ which satisfies ((3, a) = and 
a ± j3 G R. We take a non-zero vector Xp £ Qp. Then 

[x p ,v] = [Xp,x a ] + [Xp,X- a ] e {sp+ a (BQp~ a )nv c - {o}. 

This shows X± a = 0, since [gp, Q± a ) — 0p± a - Thus we obtain V = {0}. Hence 
from Corollary |4.81 Ad(G)a is not tangentially degenerate. □ 

In Proposition 14.111 we obtained the spaces of the relative nullity of the orbit 
through a highest root except the case of type BC. In the rest of this subsection, 
we shall study the space of relative nullity of the orbit through a highest root in 
the case of the restricted root system of type BC p . In this case we can put 

R = {±2ci I 1 < i < p} U {±ei I 1 < i < p} U {±ei ± e j \ 1 < i < j < p}, 
A = 2e x . 

We already know that the space of relative nullity A/a of Ad(A)A satisfies 

m 2ei C A/a C m 2ei + m ei 
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and invariant under ad (3^-). Since 

R$ = {/iei?+ I (A,/*>=0} 

= {2ei \2<i<p}U{e i \2<i<p}{j{e i ±e j \2<i<j <p], 

we have 

iK = *o + ^ = 60 + Z £2e - + E tc -+ £ l «i±«i- 

^Gfl^ 2<i<p 2<i<p 2<i<j<p 

First we determine the space of relative nullity of the orbit through a long root 
when (G, K) is a Hermitian symmetric pair with restricted root system of type BC . 
For this purpose, we recall the following two lemmas. 

Lemma 4.14 ( |12j Lemma 2.3). For a Hermitian symmetric space, the complex 
structure J translates restricted root spaces as following: 

v 

Jm ei ± e] = m etT e 3 , Jm ei =m ei , J a = y^m 2e ,. 

»=i 

We denote the Hopf fib-ration by tt : S 2n+1 — ► CP™. 

Lemma 4.15 ([TO] Lemma 2.2). Let M C CP™ be a complex submanifold of 
complex dimension k. Then n (M) is a submanifold of dimension 2k + 1 with 
degenerate Gauss mapping of S 2n+1 . Moreover, if M is compact and not a complex 
projective subspace, then the rank of Gauss mapping is equal to 2k. 

Now we shall prove the following proposition. 

Proposition 4.16. Assume thatp > 2. Let (G,K) be a Hermitian symmetric pair 
with restricted root system of type BC P . Then the space of relative nullity A/a of 
the orbit through a long root A € R is given by J\f\ = m\ . 

Proof. Without loss of generality we can put A = 2ei, and we consider the orbit 
Ad(K)X through A. The tangent space of Ad(K)X at A is given by 

T\(Ad(K)\) = ^2 "V = m 2ei + m ei + ^2 m ei±ei- 

IJ.£R+-Rf 2<i<p 

We denote by tt : S — ► CP™ the Hopf fibration from the hypersphere S in m to 
the complex projective space. Then the image Tr(Ad(K)X) of the orbit Ad(AT)A is 
a submanifold of CP™, and its tangent space at 7r(A) is given by 

T 7r(A )(7r(Ad(K)A)) =m ei + J2 m ^±^- 

2<i<p 

Therefore from Lemma [4.141 7r(Ad(AT)A) is a complex submanifold of CP™. Ob- 
viously 7r(Ad(AT)A) is not a complex projective subspace when p > 2. Thus from 
Lemma \4. 151 the index of the relative nullity of Ad(K)X C S is equal to 1. Hence 
Af x =m 2ei . a 

Proposition 4.17. In the case of (G, K) — (Sp(2p + n), Sp(p) x Sp(p + n)) (p > 
2, n > 1) , the space of relative nullity of the orbit through a long root A £ R is given 
byNx = m\. 
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Proof. We shall give the restricted root space decomposition of (G, K) = (Sp(2p 
n), Sp(jp) x Sp(p + n)). We express g as 

g = sp(2p + n) = {X£ M 2p+ „(H) | *X + X = 0}. 

We define an involutive automorphism 9 on g by 



: g — > g:X 



-L, 



p+n 



X 



-I 



P+n 



where I r denotes the r x r identity matrix. Then the eigenspaces t and m of 8 
associated to eigenvalues ±1 are given by 



e 



m 



X 



Y 



X 



*x 



X esp( P ), Y esp(p + n)| 

X e M p . p+n (H)\ . 



We take a maximal abelian subspace o of m by 

T = hEn + 





T 




-T 













tpEppj t{ £ f?. 



where denotes a matrix whose element is 1 and all other elements are 0. 
We define e, £ a by 







En 




e, = 


—En 















Then the restricted root system of (g, t) is of type BC p . We note that, when n = 0, 
the restricted root system is of type C p . 

In the case of type BC, the restricted root spaces t ei and m ei which correspond 
to ej are given by 



m. 



- { y^A x j E i^p+j ~ x J E 2 P +j,i) 



Xj £ H 



'^2(yj E P+i,2p+j - VjE2p+ 3 ,p+i) 



Vi e h 



In order to prove the proposition, we will show that TVa does not contain m ei - 
component. We take X £ m ei arbitrarily. Then [t e2 ,X] C m ei+e2 + m ei - e2 . Since 
N\ is invariant under ad(j^-), we have that if I € N\ then [6 e2 ,X] C N\ C 
tri2ei + m ei- Therefore, if I € N\ then [l e2 >^] = {0}- We can express X = 
Y^j=i( x j E i,2p+j - x ]E 2 p+ h i) £ m ei . Then 



% GHj. 

This yields X = 0. Thus Af\ does not contain m ei -component. Hence Af\ = m\. □ 
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4.2. Tangentially non-degenerate orbits. In the above subsection we have 
proved that all orbits stated in Theorem 14.11 are tangentially degenerate. In this 
subsection, we shall show that other orbits are not tangentially degenerate. 

Proposition 4.18. Let (G, K) be a Hermitian symmetric pair. (Then the restricted 
root system of (G, K) is of type C or BC.) The orbit Ad(K)X through X = e\ + e-2 
is not tangentially degenerate. 

Proof. It is sufficient to prove that if X £ m ei + e2 satisfies [t ei _ e2 , X] = {0}, then 
X = 0. From the assumption, 

= J[J ei _ e2 , X] = [t ei _ e2 , JX] . 

Therefore we have 

= (a, [e ei - e2 , JX]) = ([a, fi ei _ e3 ], JX) = (m ei _ e2 , JX). 
From Lemma \A. 141 we have JX £ m ei - e2 . This implies JX = 0, hence X — 0. □ 

In the case of (G, K) = (F4, SU (2) • Sp(3)), (G, K) is a compact symmetric pair 
which corresponds to a normal real form. In this case, we shall show that the orbit 
through a short root is not tangentially degenerate (Proposition 14. 19f . 

For this purpose, we shall recall some definitions. A real form g of a semisimple 
Lie algebra [ over C is called normal if in each Cartan decomposition g = 6 + m the 
space m contains a maximal abelian subalgebra of g. It is known that there exists 
a normal real form for each semisimple Lie algebra over C, moreover that is unique 
up to isomorphism ([5] Ch. IX, Theorem 5.10])D 

A compact symmetric pair (G, K) is called compact symmetric pair corresponds 
to a normal real form if the dual (g*,6) of the orthogonal symmetric Lie algebra 
(g, i) of (G, K) is a normal real form of the complexification g c of g. 

Proposition 4.19. Let (G,LC) be a compact symmetric pair which corresponds to 
a normal real form with a restricted root system of type B, C , or F4. Then the 
orbit through a short root is not tangentially degenerate. 

Proof. Since (G, K) is a compact symmetric pair which corresponds to a normal 
real form, t and m can be expressed as 

t= RF «> m = t © RG «, £ a =RF a , m a — RG Q , 

where F a = (E a — E- a )/^/2 and G a = V~-l(E a +E- a )/"\/2. Here E a £ g a satisfies 
that, for a, (3 £ R, if a + (3 £ R then [E a ,Ep] = N a> pE a+ p and N at p is non-zero 
real number which satisfies N a ^ = — iV_ Q ._^. 

When a is a short root, as we showed in the proof of Proposition ^. 61 there exists 
(3 £ R + such that a _L j3 and a ± (3 £ R. Then we have 

[tf3,m a ] = R(N a}(3 G a+l 3 - N- a ,pG a -p) + {0}. 

Thus, from Lemma 1431 the orbit Ad(K)a through a is not tangentially degenerate. 

□ 

From Proposition OH in the case of {G,K) = (F 4 ,S'[/(2) • Sp(3)), the orbit 
through a short root is not tangentially degenerate. 

Proposition 4.20. In the case of{G,K) = (SO(2p + n), S(0(p) X 0{p + n))) {p> 
2,n > 1), the orbit Ad(K)X through a short root X is not tangentially degenerate. 



ORBITS OF s-REPRESENTATIONS WITH DEGENERATE GAUSS MAPPINGS 



15 



Proof. In this case the restricted root system R of (G, K) is of type B p , that is 
R = {±a | 1 < i < p] U {±ei ± ej | 1 < i < j < p}. Without loss of generality 
we can put A = e\. The action of io = o(n) on m\ — R™ is irreducible, thus 
m\ is the only non-zero subspace of tru invariant under 6 . Restricted root spaces 
ro ei , t ei (1 < i < p) are given by 



m,. 







X 








-*x 

















-X 




l x 





7 



X = xiEi. 



X = x x Ei- 



Therefore, when i > 2, we have that is perpendicular to ei and 







—En 


\ 




[* ei ,m ei ] = R 
















J 





Hence, from Lemma the orbit Ad(if)A is not tangentially degenerate. 



□ 



Proposition 4.21. In the case of (G, K) = {Sp(2p + n), Sp(p) x Sp(p + n)) (p > 
2,n> 0), the orbit Ad(K)X through a restricted root A = e± + e 2 is not tangentially 
degenerate. 

Proof. When n > 1, the restricted root system of (G, if) is of type BC p . And when 
rt = 0, the restricted root system is of type C p . However, we shall consider both 
cases uniformly. In order to prove the proposition, it suffices to show that {0} is 
the only subspace of m ei + e2 invariant under ad(3^-). 

Let V be a subspace of m ei+e2 invariant under ad(3^-). We take X arbitrar- 
ily. Then [t ei _ e2 , X] C V C m ei+e2 . On the other hand, [? ei _ e2 ,X] C m 2ei ©m 2e2 . 
Therefore we have [t ei _ e2 , X] = {0}. 

Under the notation of the proof of Proposition ^. 171 restricted root spaces m ei + ej 
and iei-ej are given by 



"We, 



-- {x{E, 

{y(E k 



i,P+3 

E, 



E, 



P+i,j 



) - x(E p+j< i + E. hp+l ) I x e H}, 



P+1.P+] 



) - y(E Si + E, 



J P+3,P+i> 



yen}. 



We put X = x(E 1<p+2 + E p+1<2 ) - x(E p+2 . 1 + E 2 . p+1 ) G V. Then 

[t ei - e2 ,X] = {(xy - yx)(E ltP+1 + E p+1>1 ) + (xy - yx)(E 2 , p+2 + E p+2a ) \ y € H}. 

Therefore x must be zero for the right-hand side to be {0}. Hence V = {0}. 
Consequently we have that {0} is the only subspace of m ei + e2 invariant under 
ad( 3 k). □ 

Next we shall show when 

(G,K) = (E 6 ,SU(2)-SU(6)), (E 7 , SU(2) ■ 50(12)), (E 8 , SU(2) ■ E 7 ), 

the orbit through a short root A is not tangentially degenerate. In these cases, G/K 
is a compact quaternionic symmetric space whose restricted root system is of type 
F4. See Appendix in detail. 

Let v be in R + such that v _L A. Note that [v : m\] — {0}. We take X € ttia 
arbitrarily. From Lemma |4.9[ it is sufficient to prove that [?j,,A] = implies 
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X = 0. Now we assume that [fi^-X] = 0. Then, from the Jacobi identity and (2) 
of Lemma 13.11 we have 



= [u, [K,X]} = [[uX],X] + [K, W,X]] = [m u ,X]. 

Hence [t v + m^,X] = 0. Applying the inverse <i> _1 of the Cayley transform to the 
equality above, we have 



Y (RF a +RG a ), ®-\X) 

_aG-R,7r(<E>(a))=[/ 

Here we used Lemma 15.61 Since 

c 

(RF a + RG a 

\a£LR, 7r(<I>(a))=f 

we have 



= 0. 



^ (3a + 3-a), 

a£R,n{&(a))=v 



(Ba + Q-a), Q'HX) =0. 

_a£R,ir(&(a))=v 

Using Lemma 15.61 again, we have 

<S>- 1 (X)e<S>- 1 (m x )c<I>- 1 (tx+m x ) = £ (RF a +RG a ) 

Qe-R,ir($(a))=A 
Qe-R,7r($(a))=A 

Hence it is sufficient to prove that if 

Ye Y (9a©fl-a) 

ae-R,7r(<I>(a))=A 

satisfies 

(4.3) Y (flaSfl-a), Y =0, 

_a£R,ir(®(a)) = v 

then Y must be 0. 

We shall prove the above claim for each of the three cases. 

Proposition 4.22. In the case of (G, K) = (E 6 ,SU(2) ■ SU(6)), the orbit Ad(K)\ 
through a short root A is not tangentially degenerate. 

Proof. We may put A = 7r($(ai)). Then A is a short root, and 

(tt$)- 1 (A) = {aeR \ 7r($(a)) = A} = {ai,a 6 }. 

We set v — 7r($(a3 + a± + a§ + a®)). Then v is a short root perpendicular to A, 
and 

(7r$) _1 (^) = {a 3 + a 4 + a 5 + a 6 , a>i + a 3 + a 4 + a 5 }. 
Now we assume that 

Y = xxE ai + yiE_ ai + x 2 E ae + y 2 E_ ae e ^ (g Q © g_ a ) 

ae-R,7r(*(a)) = A 
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satisfies the condition (14. 3|) . We note that the set of roots of the form a 3 + 0:4 + 
«5 + «6 ± a where a £ (7r$) _1 (A) is 

{(a 3 + a 4 + a 5 + a 6 ) + oci, (as + ay + ag + cte) — a<6}. 

Therefore we have 

[-Ea 3 +a4+a 5 +a e j Y] 

This shows that the condition [E a3+a4+a5+a6 , Y] = yields Xi =y 2 = 0. Similarly 
the condition [EL( Q3+a4+Q5+Q6 ), Y] = yields 7/1 = 2; 2 = 0. Hence we obtain 
Y = 0. □ 

The following two propositions can be proved in a similar way to the proof of 
Proposition 14. 221 So we write only the essentials of their proofs. 

Proposition 4.23. In the case of(G,K) = (E 7 , SU(2)-SO(12)), the orbit Ad(K)\ 
through a short root A is not tangentially degenerate. 

Proof. We may put A = 7r($(a4)). Then A is a short root, and 

(7T$) _1 (A) = {ct 4 , Ct4 + Ct5, Ct 2 + Ct4, Qf2 + «4 + Ct 5 } . 

We set v = 7r(<i>(a: 3 + 04)). Then v is a short root perpendicular to A, and 

(7r$) _1 (^) = {a 3 + a 4 , a 3 + ct4 + as, a 2 + a 3 + a 4 , a 2 + a 3 + 014 + 0-5}. 

We get the assertion from the following: The set of roots of the form a 3 + a.4 ± a 
where a £ (7r$) _1 (A) is 

{(a 3 + a.4) - 0:4, {a 3 + cti) + ("2 + 0:4 + a 5 )}. 

The set of roots of the form a 3 +a4+a5±a where a £ (7r$) _1 (A) — {0:4, 0:2+0:4+0:5} 
is 



{(a 3 + a 4 + a 5 ) - (a 4 + a 5 ), (a 3 + a 4 + a 5 ) + (a 2 + a 4 )}. 



□ 



Proposition 4.24. In the case of (G, K) = (E S ,SU(2) ■ E 7 ), the orbit Ad(K)X 
through a short root A is not tangentially degenerate. 

Proof. We may put A = 7r($(ai)). Then A is a short root, and 

cti, cti + o 3 , ot\ + o 3 + 04, cti + ct 2 + o 3 + 04, 
(7r$) _1 (A) = ^ ai + o 3 + 04 + 05, oi + 02 + o 3 + 04 + o 5 , 

ai + a 2 + o 3 + 2o 4 + o 5 , ai + a 2 + 2o 3 + 204 + o 5 

o 3 + 2a4 + 2^5 + 2ae + ct 7 )). Then v is a short root 



We set v = 7r($(ai + a 2 
perpendicular to A, and 



(7r$;rV) = < 



ai + a 2 + o 3 + 204 + 2o 5 + 2o 6 + 07, 
ai + a 2 + 2o 3 + 2o 4 + 2o 5 + 2o 6 + o 7 , 
ai + a 2 + 2o 3 + 3o 4 + 2o 5 + 2o 6 + a 7 , 
ct\ + 2a 2 + 2o 3 + 3«4 + 2os + 2cyq + 0:7, 
«i + a 2 + 2o 3 + 3a4 + 3a§ + 2ae + 07, 
ct\ + 2ct 2 + 2q 3 + 3«4 + 3a5 + 2a6 + 0:7, 
ct\ + 2a2 + 2a 3 + 4a?4 + 3a5 + 2ctQ + a 7 , 
ct\ + 2a 2 + 3a 3 + 4a?4 + 30:5 + 2a^ + a 7 
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We get the assertion from the following: The set of roots of the form 01+02 
a 3 + 2a 4 + 2a$ + 2ae + ar ± a where a £ (7r$) _1 (A) is 

(«i + a 2 + a 3 + 2a 4 + 2a 5 + 2a$ + ar) — a\, 

(ai + a 2 + «3 + 2a 4 + 2a 5 + 2a 6 + ar) + {a\ + a 2 + 2a 3 + 2a 4 + as) 
The set of roots of the form a± + a 2 + 2a?, + 2a 4 + 2a§ + 2a§ + ay ± a where 
a e (7r$) _1 (A) — {ai, a\ + a 2 + 2a 3 + 2a 4 + a 5 } 

is 

(ai + a 2 + 2a 3 + 2a 4 + 2a 5 + 2a$ + ar) — (ai + a 3 ), 
(ai + a 2 + 2a3 + 2a 4 + 2a 5 + 2a§ + ar) + (a% + a 2 + a 3 + 2a 4 + as) 

The set of roots of the form a\ + a 2 + 2a3 + 3a 4 + 2a§ + 2a@ + a 7 ± a where 



:e(^)-Hx)-{ I 1 

y a\ 



ai, a 4 + a 2 + 2a 3 + 2a 4 + 05, 
a 3 , ai + a 2 + a 3 + 2a 4 + 



(a\ + a 2 + 2a 3 + 3a 4 + 2a$ + 2a§ + ar) — (ai + a 3 + a 4 ), 
(ai + a 2 + 2a 3 + 3a 4 + 2a 5 + 2a e + a 7 ) + {ax + a 2 + a 3 + a 4 + a 5 ) 

The set of roots of the form a 4 + 2a2 + 2a 3 + 3a 4 + 2a$ + 2a§ + ar ± a where 

ax, ai + a 2 + 2a 3 + 2a 4 + a 5 , 
a e (7r$) _1 (A) — { ai + a 3 , a± + a 2 + a 3 + 2a 4 + a 5 , 

a\ + a 3 + a 4 , a\ + a 2 + a 3 + a 4 + a 5 



(ai + 2a 2 + 2a 3 + 3a 4 + 2a 5 + 2a 6 + a 7 ) — (ai + a 2 + a 3 + a 4 ), 
(ai + 2a 2 + 2a 3 + 3a 4 + 2a 5 + 2a 6 + ar) + («i + a 3 + a 4 + a 5 ) 



a 



4.3. List of tangentially degeneracy. At the end of this section, we give the 
list of symmetric pairs whose ranks are equal or greater than 2 such that the orbits 
of their s-representations have degenerate Gauss mappings. All of them are orbits 
through long roots except the case of type G 2 . In the case of type G 2 both of orbits 
through a long root and a short root have degenerate Gauss mappings, and both of 
them have the same dimension and the same rank of Gauss mapping. In Table [TJ 
we denote the dimension of the orbit by I and the rank of Gauss mapping by r. 
Then tangentially degeneracy is equal to I — r. 

In the list, we can find many orbits which satisfy the equality r = F(l). In order 
to observe this we state some properties of the Ferus number. The definition of the 
Ferus number immediately implies F(l) < I. 

Lemma 4.25. F(l) < F(l + 1). 

Proof. The relation {k \ A(k) + k > I + 1} C {k \ A{k) + k > 1} implies 

F(l + 1) = min{/c | A(k) + k > I + 1} > min{fc | A(k) + k > 1} = F(l). 

a 



Lemma 4.26. F(2 q ) = 2 q . 
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type 


rank 





i 


I 


r 


Z-r 


A 


P 
P 
P 
2 


su(p + 1) 
su(p + l) 2 
su(2(p + ljj 


so(p+ 1) 
su(p + 1) 
sp(p + 1) 
f 4 


2p- 1 
2(2p-l) 
4(2p - 1) 
24 


2p-2 
2(2p- 2) 
4(2p - 2) 
16 


1 

2 

4 

8 


D 


P 
P 


soylp + 1 J 
so(2p + n) 


S0(2p + 1 J 
so(p) © so(p + n) 


op — 1U 

4p + 2n - 7 


1 O 

op — 11 
Ap + 2n - 8 


z 
1 




P 
P 
P 
P 
P 
3 


sp(p) 
sp{p) 2 

spl^Pj 
su(2p) 

an ( A n\ 

soy^p ) 
e 7 


u(p) 

Bp(p) 

sp (p) © sp (p) 
su(p) © su(p) © R 

u l^PJ 

e 6 © R 


zp — 1 
4p- 2 
op — 
4p- 3 

op — / 

33 


Zp — Z 

Ap-4 

op — O 

4p- 4 

O// — O 

32 


1 
1 

2 

q 


1 

1 
1 

1 


D 


P 
P 


so(2p) 
so(2p) 2 


so(p) © so(p) 
so(2p) 


4p- 7 
2(4p-7) 


4p- 8 
2(4p-8) 


1 

2 


E 6 


6 

D 


ee 

cq © e6 


sp(4) 
e6 


21 

4z 


20 
/in 

4U 


1 


z 


E7 


7 

7 
i 


e 7 

e 7 © e 7 


su(8) 
e 7 


33 

00 


32 

04 


1 


z 


Es 


8 
8 


es 

es © e 8 


so(16) 
es 


57 

114 


56 
112 


1 

2 


Fi 


4 

A 

4 

4 
4 
4 


u 

J4 © T4 

ee 
e 7 
es 


su(2) ffisp(3) 

£ 

su(2) © su(6) 
su(2) ©so(12) 
su(2) © e 7 


15 

oU 

21 

33 
57 


14 

Zo 

20 
32 
56 


1 


z 

1 
1 
1 


G 2 


2 
2 


02 

02 ©02 


so (4) 

02 


5 

10 


4 
8 


1 

2 


BC 


p 
p 
p 
2 


su(2p + n) 
so(4p + 2) 
sp(2p + n) 
ee 


su(p) © su(p + n) © R 

u(2p+l) 

Sp(p) ffisp(p + n) 

so(10) © R 


4p + 2n - 3 
8p- 3 
8p + An - 5 
21 


4p + 2n - 4 

8p-4 

8p + 4n - 8 

20 


1 
1 

3 

1 



Table 1. 



Proof. It is sufficient to show A(k) + k < 2 q for k < 2 q . We write k = 2 q - (2s + 1)2* 
by some non-negative integers s and t, and t = c + 4d by some < c < 3 and d > 0. 
Then t < g and we get 

A(k) = A(2 q - 2*(2s + 1)) = ^(2 t (2«- t - (2s + 1))) = 2 C + 8d - 1. 

Thus 

AO) + jfc = 2« - {2 c+4d (2s + 1) - 2 C - 8rf + 1}. 

Here 

2 c+4d (2s + 1) - 2 C - 8d + 1 > 2 c+4d - 2 C - 8d + 1 

= 2 c (2 4d - 1) - 8d + 1 
> 2 4d - 8d > 1 

Therefore we obtain 4(fc) + k < 2 q B □ 
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Proposition 4.27. Assume q > 1 and write q = c + 4d (0 < c < 3, d > 0). Then 

F(2 q + a) = 2 q 
holds for any < a < 2 C + 8d - 1. 

Proof. Since q > 1, we have c > 1 or d > 1. Thus A(2«) = 2 C + 8d - 1 > 1. This 
shows A(2«) + 2« = 2« + 2 C + 8tf - 1. From Lemmas |4~25] and B~26] we get 

2<J > F(2 q + 2 C + 8d - 1) > F(2 9 ) = 2«. 

□ 

The above proposition shows the following equalities: 

F(2 q + l) = 2 q (q>l), 

F(2 q + 2) = 2 q (q>2), 

F(2 q + 3) = 2 q (g>2), 

F(2« + 4) = 2 q (q>3). 

By the use of the above equalities, we can see many orbits of the s-representations 
which satisfy the Ferus equality F(l) = r in Table [TJ For example, the orbits of 
the s-representations of the following symmetric pairs through a long root satisfy 
F(l) = r: 

(5u(2 9 - 1 + 2), so(2'?- 1 + 2)) (<z>l), 
( 5 u(2 9 - 2 + 2) 2 , su(2 q - 2 + 2)) (q > 2), 
(su(2(2«- 3 + 2)), 5 p(2 q - 3 + 2)) (q>3), 
(ee, f4), 

(so(2p + n), so(p) ®so(p + n)) (4p + 2n - 7 = 2 q + l,p >2,n>l,q> 1), 

(5 P (2'- 1 + 1), u(2"- 1 + l)) (q>l), 

( S p(2 q - 2 + If, 5 p(2 q - 2 + 1)) (q>2), 

( 5 p(2(2 9 - 3 + 1)), sp(2 q - 3 + 1) e sp(2 9 - 3 + 1)) (q > 3), 

(su(2(2«- 2 + 1)), su(2«- 2 + 1) su(2 q - 2 + 1) R) (g > 2), 

( 5 o(4(2«- 3 + 1)), u(2(2^ 3 + l))) (g>3), 

(e 7 , e 6 0R), 

(so(2(2«- 2 + 2)), so(2'?- 2 + 2) © so(2«- 2 + 2)) (g > 2), 

(50(2(2«- 3 + 2)) 2 , so(2(2«- 3 + 2))) (q > 3), 

(e 6 © e 6 , e 6 ), 

(e 7 , 0u(8)), 

(e 7 © e 7 , e 7 ), 

(e 8 , so(16)), 

(e 8 © e 8 , e 8 ), 

(e 7 , su(2)ffi 50(12)), 

(e 8 , su(2)0e 7 ), 

(su(2p + n), su(p) © su(p + ra) R) (4p + 2n - 3 = 2 9 + l,p > 2, n > 1, g > 1), 
(sp(2p + n), sp(p) ® sp(p + n)) (8p + An - 5 = 2 q + 3,p > 2, n > 1, g > 2). 
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Furthermore the orbits of s-representations of symmetric pairs 

(g 2 , 00(4)) and (fl 2 ©02, 0(2)) 

through a long root or a short root satisfy the Ferus equality F(b) — 4 or F(10) = 8. 

Remark 4.28. When (G, K) is of rank 2, the results above were studied by Ishikawa, 
Kimura and Miyaoka |10j . 

5. Appendix : Quaternionic symmetric spaces 

A 4n-dimensional Riemannian manifold is called quaternion-Kahler if its holo- 
nomy group is contained in Sp(n) ■ Sp(l). A quaternion-Kahler manifold is called 
quaternionic symmetric if it is a Riemannian symmetric space ([1] p. 396]). 

We will review a construction of a quaternionic symmetric space from a compact 
simple Lie algebra whose rank is greater than or equal to 2 (see [13] in detail). 
Set G — lnt(0), which is a compact connected semisimple Lie group. We denote 
by ( , ) a biinvariant Riemannian metric on G. Take a maximal torus T in G and 
denote its Lie algebra by t. For a € t we set g a as (|3.1|) , and define root system R 
by [(O) . We have then 



,c 



^2 8a- 



For a € R we can take E a £ g a such that 

E a - E- a e 0, \f-T{E a + E- a ) € 



1 

V2 



(E a — E-a) 



1=1 



V2 



(E a + E- a ) 



[E a , E-a] 
= 1, 



-la, 



and that if we define N a> p by [E a , Ep] = Na,pE a+ p, then A Qj( g = —N- a ,-p where 
we put N a ,f3 = if a + (3 $ R. Let F be a fundamental system of R and denote by 
i?+ the set of positive roots with respect to F. For a e R+ set 



1 



F a — -j=(E a — E-a), 

then we have 

(5.1) fl = t+ ( Rf a+ RG «). 



G 



1 



V2 



{E a + E-a), 



l-^all — I! — 1, [^a,G Q ] — 



For each a G -R + , we define a subalgebra 0(a) of by 

0(a) = Ra + n (g a + $- a ) = Ra + RF a + RG Q , 
which is isomorphic to su(2). We denote the highest root by 5 € By Lemma 

s = exp ad 



is an involutive automorphism of 0. The fixed points set 6 of s in is given by 
t = t + HFs + HGg + ^ (RF a + RG Q ) 

= fl(5)+tn5 x + ^(RF Q + RG Q ). 

a±5 
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The subalgebras g(S) and tn 5 1 - + E Q ±<5( RF c 
eigenspace m of s is given by 

m = ( RF « + RG «) where ^+ 
Since there exists a subset R+(S) in R™ such that 

(5.2) m= (HFa+RG« + RF«-a+RG«-a), 

the dimension of m is a multiple of 4. 

We also denote by s the involutive automorphism of G induced from s. Since 
the fixed point set of s in G is closed and G is compact, the identity component K 
of the fixed points set is also compact. The Lie algebra of K coincides with t and 
(G,K) is a compact symmetric pair. Hence the coset manifold G/K is a compact 
Riemannian symmetric space. Moreover G/K is a quaternionic symmetric space 
since (|5.2|) defines a quaternionic structure. Conversely it is known that every 
compact quaternionic symmetric space is obtained in this way. We omit its proof. 
See [13] in detail. 

Quaternionic symmetric spaces have a similar property with Hermitian symmet- 
ric spaces as we shall mention below: Two roots 71,72 £ R+{$) are said to be 
strongly orthogonal if 71 ± 72 ^ R- 

Proposition 5.1. Let G/K be a compact quaternionic symmetric space of rank 
p. Then there exist R+{8) which satisfies 15. 2\) and a subset {7i}i<i< p of R+(S) 
consisting of strongly orthogonal roots such that 

p 

i=l 

is a maximal abelian subspace of m. 

The proof requires some preparation. 
Lemma 5.2. If a,f3 <E R+ and a + (3 <E R, then a + (3 = 5. 
Proof. Since a, (3 S R™, we have 

(a + M 

\\S\\ 2 

Using Lemma 14.41 a + (3 € R implies a + (3 

Corollary 5.3. [g a ,Qp] C g s for a, (3 G R+ 

Proof. If a + (3 S R, Lemma 1531 implies [g a , gp] = gs. If a + [3 $ R, then [g a , gp] = 
{0}. * □ 

If Q is any subset of i?™, let 

m Q = ^(fla +£(-<*)• 

aEQ 

Remark that ra™ = m c . For the lowest root 7 in Q, put 
Q(j) = {(3eQ-{j}\/3±itR}. 



RG Q ) are ideals of t The (-1)- 
_ P 5) 1 



= 1. 



= 6. 



□ 
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Then (3 ± 7 £ R U {0} for /3 G Q(j). 

Lemma 5.4. We denote by lm Q {E-y + -EL 7) the centralizer of E 1 + _E_ 7 in ttiq. 
Then 

3m Q (E? 7 + E-j) = triQ( 7 ) + C(.E 7 + E?_ 7 ). 
Proof. Since /3 ± 7 ^ -R U {0} for (3 G (5(7), we have 



l m Q( 7 )> 07 + 0-7J = 
Since E 1 + E- y G § 7 + fj_ 7 , we get 



XI (0/3+0-/3): 07+0- 
/3eQ(7) 



= {0}. 



[m Q(7) ,E 7 +E_ 7 ] = {0}. 

Hence we have 

m Q(7) + C(-E 7 + E-y) C 3m Q (£ , 7 + E-ry). 

Conversely let X be in 3 mq (E? 7 + _E f ). Since X G ttiq, we can express X as 

X = OyE^ + c^ 7 E^y + ^ (c p E p + c_pE_p) where Q' — Q - {7}. 

/3eQ' 

We consider the components of [X, i? 7 + £L 7 ] = in the root space decomposition. 
Since the t c -component is 

c^[Ej , -E— 7 ] + c — - [E?_ 7 ; E7 7 ] — (c 7 — c_ 7 )[.E 7 ,E7 — J, 

we have c 7 = c_ 7 , which implies that 

X = c 7 (£ 7 + E;_ 7 ) + ( c /3^/3 + C-pE-p). 

Put 

/3GQ' 

then X = c 7 (B 7 + £L 7 ) + Y and 

= [X, E 7 + £L 7 ] = [Y, £ 7 + £L 7 ] 

= J] (c /J [^,J5 y ] + c^[£; / 3,£7_ 7 ] + c-^[£;_^£l r ]+c- / 3[S_ / 3 ) £7_ 7 ]). 

/3GQ' 

Here [E^,£? 7 ] € 55 and [EL^, £L 7 ] G g_«5 by Corollary 15.31 Since /3, 7 G we 
have (/3 — 7, <S) = 0. Clearly we get [E^E^] G 0/3- 7 and [EL^E^] G 0-/3+ 7 - Since 
7 is the lowest root in Q, we have /? — 7 > for G Q' and — + 7 < 0, which 
implies that /3 — 7 7^ <5, — /3 + 7 7^ <5. Hence, if (3 — 7 G -R, then cp = and = 0. 
If /3 + 7 G -R, then j3 — S — 7 by Lemma [5.21 In this case, cp = and c_,3 = 0. 
Hence we get 

Y = ( C P E P + C -P E -P) e m Q(7)- 

/3eQ( 7 ) 

Therefore we get the assertion. □ 
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Proof of Proposition I5.il We inductively define a sequence of subsets 

R+ = Qi 2 Q2 2 • • • 2 Qs 2 Qs+i = 

as follows: Let 7.; be the lowest root in Qi and set Qj+i = Qi(ji)- Since the 
cardinal numbers of {Qi} are strictly monotone decreasing, the operation is finished 
at finitely many times. Hence we can define 71, ... ,73 £ Set 

i=i 

We shall show that b is a maximal abelian subspace of m c . By the definition of 7^, 
two distinct roots 7j and 7, are strongly orthogonal. In particular b is an abelian 
subspace. In order to prove the maximality of b, set = TriQ i and define a sequence 
of subspaces in m c by 

m c =mi=mi + bDrri2 + bD---Dm s + bD m s+ i + b = b. 

We shall show that if X e m c satisfies [X, b] = {0}, then X G b. In order to prove 
this, it is sufficient to show that if X £ m p + b then X € ra p +i + b. We can express 
X e trip + t ) as 

X = Y + Z (Y em p , Z e b). 

Since [X, b] = {0}, we have 

= [X, E lp + E_ lp ] = [Y, E lp + £L 7p ], 

which implies that Y € im p (E lp + £7_ 7 ) = m p+ i + C(_E 7p + E^ lp ) by Lemma [5^41 
Hence X = Y + Z is in rrip+i + b. 

Since 7,; + 7^ 7^ <5, we can take a subset R+(6) which satisfies (I5.2[) and contains 

{7i}l<i<p- 

□ 

Hence m is given by the following: 

v 

m = a + ^(RG 7i + RF,5_ 7i + RGa_ 7i ) 
1=1 

+ ( RF » + RG « + Ri? 5-a + RGi-a) 

aefl+(5)-{7i,--- ,7 P } 

When the root system of G is not of type G2, then ||7i || = ■ ■ • = ||7 P || • Set 
b = tn{7i,— ,7p} X , t' = a+b, 

then t' is a maximal abelian subalgebra of g containing a. We define the Cayley 
transform $ by 

( p G \ 

and set = UTiHi^j, then 

$(7i) = Ai, $(H) = H (Heb). 
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Hence the Cayley transform <I> maps t onto t'. We denote by R the restricted root 
system of (G, K) with respect to a. Let 7r:t' = a+ b^abe the orthogonal 
projection, then R = 7r($(i?)). Since 

a = ^ W 7» mod b for a G _R, 



we have 

which implies that 
(5.3) 

In particular 



{Ai,--- ,A p }ci?= <J2 

{ i=l 



7^ li) 
l7.ll 2 



A, 



a£R 



The multiplicity m(A) of A = 7r($(a)) G S (a G i?) is given by 
m(A) = G i? | (a,7i> = (/3,7i)}- 

By (15. 3p , we have 



K<&(a))|| 2 = ]T 



7i 



<l|n|| J , 



and the equality holds if and only if a G span{7i, • • • , j p }. Hence ||7r($(a))| 
||a|| 2 for any a G R if and only if p = rank(G). 

Lemma 5.5. RG 7i c ta\ i , Rji c 6a* ■ 

Proof. For H — J2 x j Aj G 0, we have 

= XiHf A = (^> A i)i 7 " 



117*1 



|7i| 



= $3 *i hjll 



Il7i| 



Il7i|| 

= -Xi||7j|| 2 G. 



7j 



(if, Ai)G 7 ., 



where we used (|5 . 1 [) . 
Lemma 5.6. 

«A+m A = $l ^ (R^ Q +RG a ) 

\QS-R,7r($(a)) = A 

Proof. Since 

«A+m A = {Xg | [H,[H,X]} = -(\,H) 2 X (He a)}, 

RF Q +RG Q = fln(g Q +§-a) 

= {X e 3 \[H,[H,X}} = -(a,H) 2 X (H G t)}, 



□ 
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$ ]T (RF Q + RG Q ) 

\a£fl,7r(3>(a))=A 

= <M E [H,[H,X]] = -(a,H) 2 X (Het)} 

E {re fl |[*(H),[*(H),y]] = -<$(a),$(H)) 2 y (ffet)} 

aeK,7r($(a))=A 

E {^g|[ff,P^E = -m^ (Het')} 

C E { y e fl I [if, [if, Y\] = -(n(<P(a)),H) 2 Y (H e a)} 

ae-R,7r(*(a))=A 

= tA + m A . 

Here dim(6,\ + m\) = 2m(A). Since <I> is a linear isomorphism, we have 

dim$ E (R-F Q + RG Q ) J = dim E (RF a + TlG a ) 

\aeR,ir(<S>(a))=\ ) aGfl,7r($(a)) = A 

= 2#{a G i? | 7r(*(a)) = A} 
= 2m(A). 

Hence we get the assertion. □ 
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